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Higher education in general (Bogue, 1998) and study abroad programming 
in particular (Gillespie, Braskamp & Braskamp, 1999) arc hardly strangers to strin- 
gent demands lor accountability. What // new to higher education and to study 
abrixid is the demand for accountability in terms of measurable student learning 
outcomes. This article is a first report from a system-wide initiative to document 
learning outcomes accruing from participation in study abroad. It focuses on one 
element ol that initiative, a comparison of several outcomes between study abroad 
participants and non-participants attending sixteen varied public institutions within 
a state university system. 

Learning Outcomes Assessment 
In Higher Education 

Typically, the indices of institutional effectiveness to which colleges and uni- 
versities have been held accountable in the past included almost everything but stu- 
dent learning (Wellman, 2001). Reports to governing boards and accrediting agencies 
compile information about a host ol input measures (e.g., entering SAT scores, faculty 
credentials, conformance ol curricula to disciplinary standards, adequacy of library 
resources) and output measures (e.g., year-to-year student retention, graduation rates, 
efficiency of the bursar's office). For example, two ol the three student outcome mea- 
sures explicitly mandated by the Southern Association of Colleges and Schools (Com- 
mission on Colleges, 2000) are course completion rates and job placement rates. 
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Although these arc all useful factors in looking at the productivity. efficiency, and 
effectiveness of the educational enterprise — and the GLOSSAR1 project itsell will 
include a phase that measures the impact of study abroad on performance measures like 
graduation rates — at best these tend to approximate student learning outcomes through 
corollary* data rather than measuring learning directly. 

Student learning is, alter all, the rjiion J lire for the entire higher education 
enterprise, yet several factors have led accountability processes in the past to skirt 
learning outcomes assessment (Zernike, 2002). First, the most prized learning out- 
comes such as advanced critical thinking, oral communication, and WTitten expression 
tend also to be the most difficult to measure empirically. Faculty are understandably 
wary of the threat of instructional standardization that seems to attend efforts at pro- 
gram -wide learning assessment. In addition, educators fear the possible consequences 
should a well planned learning assessment tail to demonstrate meaningful qualitative 
improvements (e.g., Chenoweth et al, 1999). 

Notwithstanding those concerns, the currently ascendant trend in higher educa- 
tion accountability institutes a more central role for student learning outcomes assess- 
ment (Allan, 1 996; Commission on Institutions of Higher Education, 199®; McDaniel, 
Felder, Gordon, Hrutka Ac Quinn, 2000). This heightened accountability specifically 
directed toward student learning is fueled in part by increased competition lor student 
enrollment. In this environment, higher education stakeholders are no longer satisfied 
that an official seal on a diploma signifies an adequate level of learning among gradu- 
ates. Instead, constituents seek bird evidence that their investments have yielded real 
dividends in terms ot demonstrable gains in student knowledge and skill between 
admissions and graduation < Wellman, 2001; Zemike, 2002). 

At the some time, the movement associated with the scholarship of teaching and 
learning (Hutchins Ac Shulman. 1999) has brought new creativity to ways that educa- 
tors can compile publicly accessible documentation of student learning (Palomba Ac 
Banta, 1999). Thus, for example, college teachers in a wide range of disciplines have 
instituted the practice ol assembling portfolios ol student work demonstrating progress 
across the span of a term or of an entire college career. They adopt portfolio assessment 
not only as a tool for providing students with rich feedback and valid course grades, 
but also as a tool for demonstrating the impact of instruction on learning outcomes 
(Cambridge. 1996). 

Institutional Data on Study Abroad 

The number of students participating in study abroad programs has often been 
taken as one indicator ol overall institutional quality, and certainly a campus which is 
heavily invested in international education is likely to offer a stimulating learning 
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environment. From any point of view, increasing participation in study abroad contin- 
ues to be a laudable educational goal. But simply knowing how many students stud- 
ied abroad is not equivalent to knowing what knowledge those students acquired (or 
failed to acquire) as a result of that experience. The learning outcomes assessment 
paradigm enjoins educators to evaluate study abroad programs not only in terms of 
institutional indicators such as enrollment or resources for student and academic sup- 
port (see Gillespie, Braskamp & Braskamp. 1 999), but also in terms ok direct measures 
ol knowledge gained. 

Participant Satisfaction and I m p a c t S u r v e y s 

Because they* are elective, often financially self-supporting entities operat- 
ing in a highly competitive milieu, study abroad programs have always been 
highly accountable to their "customers" (parents as well as students), to university 
administrators, and to the faculty who sanction and teach in them. But like the 
colleges and universities which sponsor them, study abroad programs have tradi- 
tionally relied on institutional indicators of effectiveness such as number of credit 
hours generated and records ol student health and safety. In addition, many study 
abroad administrators compile opinion survey data (see Cash. 1993) collected 
from student participants. Such questionnaires often ask students to rate their 
satisfaction with various aspects of the program (e.g., "1 was able to enroll in the 
classes I needed* or ’My host tamily was triendly and helpful* or "I would recom- 
mend this program to other students at my college'*). 

Some exit questionnaires also ask participants to evaluate the brood impact that 
the experience has had on their goals and personal traits (see. for example. British 
Columbia Centre for International Education, 2002; Hansel Ac Grove. 1986; Laubscher. 
199^)- Such teedback can be quite valuable to administrators in their efforts for con- 
tinuous quality improvement, as well as in recruiting students and in solidifying 
institutional support. Nonetheless, student opinion data and self-assessments of per- 
sonal growth do not speak directly to issues ot academic benefit. When program 
evaluators have asked students to provide self-estimates of academic achievement en- 
gendered by study abroad (see Carlson et al. 1990). the resulting analyses do share 
some characteristics of learning outcomes assessment, since they do inquire about per- 
ceived student learning. Nevertheless, to the degree to which those sell-estimates refer 
to generalizations about knowledge gain (e.g., ”1 learned a great deal in my classes 
abroad" or "My personal study habits improved as a result of studying abroad") rather 
than inquiring about discrete items from a specific content domain, these sell-assess- 
ments support generic values of study abroad, rather than more tangible demonstra- 
tions of improved learning outcomes. 


6 ? 



Sutton t Ruble 


Psycho -social Outcomes 

Outcome assessment that pertains to attitudinal and dispositional changes 
participants experience as a result of their international sojourns has frequently been 
applied to study abroad. This research is of theoretical as well as practical importance 
because it bears on broad issues such as individual response to stress and the effects of 
inter-group contact. Social and psychological variables ol interest include indi- 
vidual autonomy or sell-efficacy, cognitive flexibility, sociability, interethnic toler- 
ance, and world -mindedness (e.g., Carlson 6c Widaman. 1988; Lathrop, 1999; Nash. 
1976; Paige, et al, 2002; Ryan 6c Twibell, 2000). It is difficult to generalize across 
this work because ol the variety of psychological instruments used and the differing 
patterns of findings. Taken as a whole, this body of research suggests that studying 
abroad has a salubrious effect on many psycho-social outcomes, although not all. 
Extensive cultural immersion is believed to exert a greater impact than "island* 
study abroad programs (Sell, 1983). The persistence of any of these psychological 
effects over long periods of time remains far Irom certain, however. Additionally, it is 
an open question whether certain campus-based multicultural training experiences 
might bring about attitudinal and dispositional changes commensurate with those 
obtained Irom overseas study. 

The potential psycho-social outcomes ol studying abroad — self-efficacy, world- 
mindedness, and the like — are certainly among the most desirable attainments that a 
student may acquire during a college education. They differ Irom the more specific 
definition of learning outcomes used in this and other studies in that they are not 
direct reflections of academic achievement per se. They are personal attributes and 
attitudes that may be attainable by any number ol cross-cultural life experiences. The 
application of learning outcomes assessment to study abroad means asking questions 
specifically about how the curricular content knowledge and cognitive understand- 
ings of participants have (or have not) improved. 

Learning Outcomes In 

Foreign Language Study Abroad 

Foreign language study is one academic discipline in which the spirit ol learn- 
ing outcomes assessment has been actively applied to study abroad. Foreign Language 
educators have long been interested in identifying aspects of toreign language study 
conducted in the target language host environment that produce results superior to 
those from home-country language study (Freed, 199^; Milleret. 1990). The supposi- 
tion, quite naturally, has been that students who interact Irequently with native speak- 
ers in authentic situations will be advantaged over those whose language learning is 
limited to the classroom. While some studies have indeed yielded findings consistent 
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with that view (e.g., Yager, 1998), other studies hive surprisingly concluded that study 
abroad can actually undermine grammatical accuracy in the target language; students 
immersed in home stay situations sometimes achieve lesser gains in language proficiency 
than do students who reside in international program residence halls (c.g., Rivers, 1 998; 
Veguez, 1984). One ol the more extensive and carefully designed evaluations ol foreign 
language learning outcomes in the context of study abroad was sponsored by the Ameri- 
can Council of Teachers of Russian (Ginsberg, 1992; Rivers, 1998). The Council's 
findings serve to remind educators that foreign language learning outcomes from study 
abroad — yust hlce outcomes on domestic campuses — can be highly variable: study abroad 
is no guarantee ol satisfactory learning. Gains in language proficiency are predicted less 
by contextual factors like the setting in which the language is studied than by student 
individual differences such as gender and previous language background. 

Beyond the domain of foreign language education, a number of manifestoes 
have called for expanding learning outcomes assessment to broad -based evaluation of 
study abroad programs (c.g., Gillespie, et al., 1999; Rubin & Sutton, 2001; Sideli, 
2001; Vande Berg, 2001). Yet to date, assessments focusing on cognitive, academic 
outcomes of international education have been relatively rare. Accordingly, the Uni- 
versity System of Georgia Learning Outcomes of Students Studying Abroad Research 
Initiative (GLOSSAR1) was launched in Fall 2000 as a concerted and systematic inves- 
tigative process to address these unanswered questions. 

Scope of the GLOSSARI Project 

The University System cS Georgia (USG) is comprised ol thirty-four public 
institutions, currently enrolling nearly 210,000 undergraduate and 38,000 graduate 
and professional students. Campuses range from small, rural two-y ear colleges to large, 
cosmopolitan doctoral research -intensive universities. Eighty-nine percent of under- 
graduates are Georgia residents, more than one-third ol entering freshmen are first- 
generation college- goers, 33 percent are ocher than Caucasian, 39 percent arc women. 
Regents' policy requires two high school Carnegie units of foreign language coursewock 
foe admission. The average SAT score of entering freshmen at USG campuses ranges from 
802 to 1323. A single Board of Regents governs all 34 institutions. 

Georgia is among a small group of states with a system-wide international edu- 
cation office. USG s international education governance structure is led by a presiden- 
tially-appointed System Council on International Education and supplemented by a 
System committee on study abroad, world regional councils, and disciplinary con- 
sortia which help facilitate coordination of overseas study. USG's inter-institutional 
catalog of study abroad programs annually lists nearly 273 international study 
opportunities for its students. These span the gamut from ten -day island programs in 
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London to yearlong exchange programs in Hiailand. Thu diversity of student bodies, 
institutional missions, and scudy abroad programming makes the University System of 
Georgia an ideal host for developing a model learning outcomes assessment initiative. It 
has the infrastructure, authority, and commitment to support such an ongoing effort. 

The University System of Georgia is noteworthy for the high priority that its 
Board ol Regents has placed on study abroad. As early os 1995% the Regents' strategic 
plan called for doubling the numbers ot Georgia students who studied abroad by 2001. 
Having achieved that goal, the Board s new strategic plan again calls for a major increase 
in study abroad participation — to 25% ot undergraduate degrees awarded by 2007 
(approximately 6,200 students). As part of its dtxumentation for annual reports to the 
Regents, since 2002 the System Office of International Education has collected detailed 
information about each student (by name and identification number) and their study 
abroad experience (country ol study, duration, etc.). Tilts extensive data collection effort, 
now totaling nearly 4,000 individual records annually, provides a rich, sell-standing 
resource for analysis of study abroad patterns and characteristics. Tlse System Office of 
International Education da t abase can be linked to other USG databases to extract addi- 
tional data about study abroad participants. In addition to supporting analysis ol student 
demographic data, an important function at this design is its ability to access pre- and 
post-participation academic performance measures and behaviors. 

The Georgia Systems GLOSSAR1 project is a sustained initiative that currently 
encompasses six components: 

• Phase 1: Comparison ol study abroad participants and non -participants on 
self-reported learning outcomes; 

• Phase 11: Comparison of pre-departure and post -departure sell-reported learn- 
ing outcomes; 

• Phase 111: Comparison of study abroad participants and non- participants on 
course-specific examinations; 

• Phase IV: Comparison of study abroad participants and non-participants on 
academic performance measures, such as graduation nates and licensing ex- 
amination outcomes; 

• Phase V: Correlation of learning outcomes with program design features, c.g., 
orientation, length oi stay, location, post-return debriefing, percent of un- 
structured time in the heat nation, etc.; 

• Phase VI: Comparison ol study abroad alumni and non -participant cohort on 
self-reported learning outcomes, career paths, and other factors two-to-five 
years alter graduation. 
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At the time of this publication. Phases 1 through V are in various stages of data 
collection and analysis. This paper presents the first set ol findings from Phase I. 


Methods 

Sample and Procedures 

A distinctive feature of Phase 1 ol the GLOSSAR1 project is its use of a partici- 
pant group and a non-participant control group, each numbering about 250 indi- 
viduals. Members ol each group completed the same survey instrument, and respondents 
were uniformly screened for external variables that might interfere with the accuracy of 
the findings. 1 

The population of study abroad participants consisted of all USG students who 
enrolled in USG -sponsored programs during the summers of 1998, 1999. and 2000 as 
well as fall semester 2 000. 2 The research team sampled from that population by asking 
the program directors to provide names of participants in their respective programs 
during the designated terms. 1 The response trom program directors was spotty. Partici- 
pants with functioning e-mail addresses were contacted (and re-contacted if necessary) 
via e-mail. They were provided with the URL ol an internet website on which the 
study questionnaire was installed. Participants with viable postal addresses were sent 
(and resent, il necessary) paper copies of the survey questionnaire. These individuals 
were also informed of the web-based option for responding, and several chose that 
route instead ol returning their hard copy instruments. Some number of participants 
may also have spontaneously accessed the survey internet website. 

The final study abroad participant sample consisted ol 255 usable responses. 
Participants attended sixteen different USG institutions. Males comprised 25.5# 
the sample, and students of color represented 12.4 % (5.7% of the total were African- 
Amencan). This composition of the sample varies somewhat trom the USG's overall 
study abroad participation demographics, as well as those reported in other surveys cf 
study abrixid students (Institute of International Education, 2003). It does not appear 
likely that these variations influenced the reliability of the survey results; a replication 
ol the Phase 1 study with sample groups drawn from fully representative populations is 
being planned to verify this assumption. 

The comparison group sample of students who had never studied abroad was 
largely a sample of convenience and was not strictly correlated with demographic 
characteristics of the participant group. One-hundred -fifty were solicited trom com- 
munication students at a large university; these students received course credit in 
exchange for their participation. Ninety-two of these responses were collected in 
large group settings via hard copy questionnaires; the remainder were collected 
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on-line Other comparison group students were solicited as volunteers by their in- 
structors in a variety of subjects (e.g.. a cross -disciplinary capstone senior seminar). 
All of those responded on-line. 

The comparison group consisted of 249 college students. These students were 
enrolled at six different institutions. Males comprised 41.3#, and students of color 
21% (8.9% African-American). The proportion of both males and minorities was 
significantly greater among the non-fxirticipant group than among the study abnxid 
group. Tfie planned replication ol the Phase 1 study with scientifically drawn sample 
groups will verify* whether this discrepancy had any effect upon these initial findings. 

Questionnaire Construction and 
Factor Analysis 

The objective of questionnaire development was to create an instrument that 
would be specific to the kinds ol learning outcomes that might be derived trom 
studying abnxid. but which would be sufficiently generic to work across a wide 
variety of programs in a diverse set disciplines. It was determined that learning 
outcomes would be sampled from five different content domains: (a) knowledge of 
strategies and skills for functioning in other cultures, (b) knowledge of intercultural 
interaction techniques, (c) global interdependence, (d) knowledge of comfxirative 
civics, and (e) knowledge ol world geography. Items measuring the first two c^ these 
domains were adapted trom a communication competence questionnaire frequently 
used in intercultural training workshops (Fantini. 1995). Additional demographic 
questions and questions regarding students' backgrounds and the nature of their 
international expenence also appeared. 4 

The GLOSSAR1 research team conducted a factor analysis to identify* the under- 
lying dimensions of intercultural knowledge reflected in the survey responses. This 
also consolidated the number of variables in the comparison between students who had 
studied abroad and those who had not. 

Principal component analysis of the 34 survey items extracted seven compo- 
nents (factors) meeting the conventional criterion of eigenvalues exceeding unity. 
Collectively these accounted for 60% of the total variance. These components were 
subjected to oblique rotation, since it was assumed that they were correlated. Items 
were considered to be significantly loaded on factor it they met a simplex criterion of 
factor coefficent greater than .35 on one and only one factor. Four items failed to 
meet that criterion. 

Ten survey items emerged as clustered under Factor 1 and pertain to functional 
competencies. Factor 2 (five items) reflects knowledge of global interdependence. 
Factor 3 (four items) pertains to knowledge of cultural relativism, while Factor 4 (three 
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items) focuses on knowledge of vertol acuity. Factor 5 (three items) taps knowledge 
world geography. Factor 6 (two items) measures knowledge ol interpersonal accommo- 
dation and Factor 7 (three items) reflects cultural sensitivity/ 


Results 

Table 1 provides results ol the seven t- tests comparing students who studied 
abroad with those who did not. We chose to use a conservative criterion for statistical 
significance (.05/7, or p< .007 1) 6 Using this standard, students who studied abroad 
exceeded the comparison group on the following measures: functional knowledge (Fac- 
tor I), knowledge of world geography (Factor 5), knowledge ol cultural relativism 
(Factor 3X arid knowledge ol global interdependence (Factor 2). The groups did not 
differ significantly on the dimensions ol verbal acumen, interpersonal accommodation, 
or the somewhat unreliable measure ol cultural sensitivity (Factors 4, 6, and 7). 


Table 1: Comparisons between study abroad participants and non participants 
on seven learning outcomes 
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Effects of Studying Abroad, 
or Effects of Better Students? 

A study such is this on e, which seeks to establish effects of studying abroad cxi 
learning outcomes, is always vulnerable to alternative explanations for any significant 
differences tound. Especially in the absence ol pre- sojourn comparisons between the 
two groups, it is reasonable to argue that any differences between those who have 
participated in study abroid and those who have not are simply due to the elite 
academic status of those who typically choose to study abroad, and not at all attribut- 
able to the study abroad experience. In part to address this reservation, we conducted 
two post -hoc analyses on the data. One considered the influence of students' prior 
academic achievement, and the other examined the influence of academic major. 

First, we rr-ran each of the seven t-tests treating students' sell-reported grade 
point averages (GPAs) as a covariate. Co-varying GPAs would have the effect of elimi- 
nating the mean differences between study abroad participants and non-participants, 
were those differences really due simply to overall academic ability. In fact, group 
differences disappeared on none of the four dimensions which had manifest effects of 
studying abnxid — functional knowledge, knowledge of world geography, knowl- 
edge of cultural relativism, and knowledge of global interdependence. This analysis 
supports the view that the differences found due to studying abroid were indeed true 
differences and not a contounding artifact ol pre-existing group inequalities in levels 
ol academic achievement.' It indicates that the impact ol studying abroad on learning 
outcomes is robust and not confounded with the typically higher GPAs held by 
students who choose to go overseas to study. 

A second analysis by which we addressed the plausibility of other confounding 
academic variables was to conduct comparisons between students U'stbsn the same oca- 
Jcjnk maprs who studied abroid and those who did not. If more humanities majors 
thin science majors study abroad, and humanities majors typically have superior knowl- 
edge of global interdependence or cultural sensitivity, then perhaps the group differ- 
ences found in a study such as this are better attributable to academic major than to the 
study abroid experience. 

The specific statistical approach we took to examining differences within majors 
required us first to identity those majors which had at least filteen students in both the 
study abreud participant and non -participant groups. This was necessary to ensure 
robust comparisons between cell means. Four majors met that criterion: education (19 
study abnxid participants, 23 non -participants), business (43 participants, 63 non- 
part ici punts), journalism and media (21 participants, 19 non-participants), and social 
sciences other than international relations or area studies (33 participants, 27 non- 
participants). Students in all ocher majors were excluded from the following analyses. 
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We then conducted 2 (study abreud participation) x 4 (academic major) analyses 
ol variance (ANOVAs) foe each of the seven learning outcome dimensions. We were 
looking for main effects of academic major, which would indicate that some of our lour 
designated mayors exceeded the others on one or more of the seven learning outcomes we 
examined. More so, w*e were looking for interactions between study abreud participation 
and academic mayor on any of the learning outcomes. Should such an interaction emerge, 
it would permit additional comparisons to determine whether the advantage for study 
abroad participants held up across the board, or only in certain majors. In order to avoid 
spurious findings due to a large number ol mxi- independent statistical tests, we again 
adopted the conservative significance level ol p<.007i. 

This second post-hoc analysis established the following points: 

■ The only statistically significant effect on Factor 1 (functional knowledge) 
was the main effect for study abroad (F, J44 - 1 1 1.52; p<.001 , eta 1 -. 3D. Hus 
was also true for Factor 5 (knowledge of geography) (F^-3-90; pc.OOl, 
eta 1 -. 033). 

■ Study abroad exerted a powerful effect on Factor 2 (knowledge of global 
interdependence) (F lJ44 - 13.08; p<. 00 1, eta 1 -. 051). A main effect for major 
also emerged for this learning outcome (F^^-5.63; p«:.001, eta 2 -.065). 
Post-hoc pairwise comparisons between cell means (Student- Neuman -Keuls 
procedure) indicated that education mayors (M^- 15.90) scored significantly 
lower on this variable than did students in the other three majors, which did 
not differ among themselves <M^- 18.92; M^- 18.08:M m -17.87). 

■ Factor 3 (knowledge of cultural relativism) data showed that study abnxid 
status exerted the most powerful effect <F | ^ 4 -27-23;p< OOl, eta 1 -. 10); how- 
ever, academic mayor also prosed to be a significant factor (F^^-6-24; p<. 001 , 
eta 1 - .071). Pat -hoc cell mean comparisons (Student-Neuman- Keuls) indicated 
that business mayors (M^- 1 5-99) scored lower on this knowledge outcome than 
did the other three majors (M^- 17.19; M^- 17.18; M ^ -17.66), which did 
not differ among themselves. 

■ No statistically significant main or interaction effects were evident for knowl- 
edge of verbal acuity, knowledge of accommodating to others, or cultural 
sensitivity knowledge (Factors 4, 6, and 7). 

In sum, this set of two-way ANOVAs tound that — even when taking students’ 
majors into consideration — experience in study abreud exerted an independent and espe- 
cially potent impact an four ol the seven learning outcomes. College mijor did exert an 
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impact on two of the learning outcomes (Factors 2 and 3) — regardless of whether students 
had studied abroad — but this effect did not negate that of studying abroad. 

Discussion 

The present study ls the first step in a long-term, comprehensive approach to 
assessing student learning outcomes from studying abroad. It constitutes the first compo- 
nent of a much more comprehensive evaluation project in the University System oi 
Georgia, and it complements a variety of other research initiatives going forward in the 
U.S. and, to a lesser extent, in other countries. In addition to the self-reports of generic 
study abroad learning outcomes that are reported here, a hilly developed learning out- 
comes assessment effort should examine a vast array of program-specific outcomes such as 
test scores, transcrip ted grades, and impact on professional licensing examinations, among 
many other things. The range ol learning outcomes research reflected in the articles cS 
this special issue of FrvxJtcn demonstrates that the field of international education is 
moving forward to confront the challenges of a data-driven, evidentiary-based art x illa- 
tion of the values gained from study abnxid. The diversity ol methodologies and ap- 
proaches lends strength to the insights gained trom these initial studies. 

The GLOSSAR1 project is intended to address concerns ol multiple constituen- 
cies through a series of structured investigations that pose basic questions about the 
academic consequences ol studies abroad. International education, despite the relative 
improvement of its standing within the higher education environment over the past 
two decades, remains subject to careful and frequently well-deserved scrutiny trom 
many quarters. As the field matures, it bears the responsibility to provide data, facts, 
and analyses that dtxument the value of its endeavors to those both within and beyond 
the international and higher education communities. GLOSSAR! seeks to contribute 
to this discussion by asking questions that are relevant to many dilferent parties. To 
governing boards, legislative funding partners, and higher education leaders, it fo- 
cuses on performance measurements ol paramount importance to their decisions, such 
as retention rates, graduation rates, and licensure pass rates (our preliminary findings 
in this phase of the project indicate some dramatic results, which we hope to release 
soon). To faculty and academic deans, it attempts to determine whether students learn 
specific course knowledge more or less effectively in a foreign environment (this is 
particularly important in disciplines that have been traditionally less enthusiastic 
about sending their students abrtx&d). To students inclined toward study abroad and 
their parents, it attempts to demonstrate in measurable ways the value added to a 
college education. To those by nature more resistant to studying abroad — perhaps the 
most at-risk population our profession should be aggressively cultivating — GLOSSAR] 
seeks to offer tangible proof of return on the investments of time, mooey, and energy 
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required. As the project investigates these and other fundamental hypotheses, it is 
committed to providing sufficient scope, scale, and scientific rigor to produce valid, 
verifiable, and replicable results. 

Within this broad context, the present study asks the question: do college stu- 
dents who study abroad achieve learning outcomes that are significantly better than 
those who do not? The results warrant the conclusion that studying abroad does add 
value to a student's academic achievements. The study also offers a number of findings 
that can inform subsequent assessments ol study abnxid learning outcomes. The seven 
dimensions ol learning outcomes revealed by factor analysis can serve as the basis of 
additional assessment efforts. 

The first of these dimensions, functional knowledge, captures the knowledge base 
needed for efficacy in navigating daily routines within a new environment. Many study 
abroad participants regard functional knowledge as an especially empowering and trans- 
formative outcome of their experience, for it instills confidence that one can achieve goals 
even in unfamiliar settings (Juhisz Ac Walker, 1988; Lachrop, 1999). Students who hid 
studied abroid reported a higher level of functional knowledge than did their peers who 
lacked this horizon-broadening experience. This was the largest effect that we found in 
this study; over 30% af the variance in this outcome could be attributed to studying 
abroad. One would expect that functional knowledge — sixh as how to make a phone 
call from abroad, how to locate a safe night spot, or how to pacify an angry merchant — 
is particularly enhanced by programs that provide participants with large amounts of 
time during which they tend for themselves. However, this hypothesized advantage c^ 
unstructured time needs to be affirmed by additional empirical study. 

Knowledge of global interdependence, the second dimension of our learning 
outcomes investigation, is often cited os the underlying reason why study abnxid 
should be pursued as a national goal. The NAFSA: Association of International Edu- 
cators proposal for a U.S. international education policy incorporates this precept 
(NAFSA, 2003), as does a related proposal by the American Council on Education 
(ACE, 2002). It is quite possible that students who choose to study abroad already 
possess high levels of this awareness, but our data indicate that the study abroad 
experience exerts an impact on this outcome beyond the students academic major. In 
this, our findings concur with previous studies that saw increased political awareness 
as a result of studying abroad (Carlson Ac Widamon, 1988). We did, however, also 
identify an independent effect for academic major. Regardless of their study abrtxid 
experience, education majors evinced lower leveLs of this knowledge than did their 
peers majoring in business, ocher social sciences, or in journalism. One implication of 
this finding is that teacher preparation curricula need to inculcate greater knowledge 
of global interdependence among future public school teachers (see Schneider, 2003). 
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Knowledge ol cultural relativism is the cognitive realization that one ought not 
judge other cultures or respond to individuals Irocn those cultures based on one’s own 
ethnocentric values and practices. Because this is an academic learning outcome, it 
should not be confused with altitudinal orientations toward ethnorelativism (Bennett, 
1986), which has also been pursued as a measurable outcome of studying abroad 
(Paige, et al., 2002). Conversely, our conception ol this knowledge outcome encour- 
ages students to reflect on the limits ol their relativism: where they draw the line c^ the 
tolerable in others' cultural practices. We have yet to explore the relationship between 
cultural relativism as an academic learning outcome and reduction ol ethnocentrism as 
an affective change or tendency to associate with culturally diverse friends as a behav- 
ioral change, all of which may or may not arise from intertultural contact (Rubin 6c 
Lanutti, 2001). 

Studying abroad accounted for 10% of the variance in knowledge of cultural 
relativity in cxir results. Academic ma|or exerted a less powerful, but still reliable, 
effect. In particular, business majors were found to score lower on this type of knowl- 
edge than were students enrolled in other majors. Certainly in an increasingly global 
business environment, undergraduate programs in business may need to be more atten- 
tive to helping students understand the nature of cultural relativism as a learning 
outcome (sec Cheney, 2001). 

Finally, study abroad participants exceeded students with only domestic college 
experience in knowledge of world geography. From one point of view, it may seem that 
this particular effect must surely be a result of selectivity in the two samples; those who 
are attuned to world geography are more likely to choose to study abrtxid. After all, 
there is no direct connection between spending three months studying art history in 
Florence and knowledge of South American capital cities. On the other hand, that U.S. 
art history student might very well encounter a group of students from Montevideo 
who are sojourning in Florence for the same purpose. Or he may befnend a young 
tourist returning to Tel Aviv by way of Italy who regales our study abroad participant 
with tales accumulated during a season backpacking from Buenos Aires to Quito. For 
this outcome, a careful comparison between pre- and post-sojourn data (in Phase 11 of 
the GLOSSAR1 project) will yield particularly interesting insights. 

Although one can never confirm a null hypothesis, it is interesting to note the 
cluster of outcomes tbit were kw affected by studying abroad nee by major in this study. 
Tbey were (a) verbal acumen, <b) knowledge of interpersonal accommodation, and (c) 
knowledge of cultural sensitivity. What these variables arguably shire in common is a 
rather direct linkage to knowledge of interpersonal communication skills, especially an 
emphasis on interpersonal flexibility. While previous research has examined a great num- 
ber of variables that are logically related to interpersonal skills (e.g„ social self -efficacy, see 
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Lithrup. 1999X our finding warrants additional study ot behavioral ai>d lActhv — as well 
as a c ad e mic — effects ol studying abroad on communication competence. 

Like all social science and educational research, the findings reported here must 
be interpreted in light of the specifics ol sampling and measurement. It is risky to 
generalize our conclusions to groups oS study abroad participants who may have re- 
ceived lesser or greater pre-departure orientation or post -sojourn debriefing, or who 
may have studied in greater numbers in developing nations. No doubt our conclusions 
will be modified by the findings ol future learning outcomes assessments conducted 
on other populations. On the ocher hand, it is worth reiterating that our sample does 
derive from a good number of rather diverse institutions and study abrtxid programs. 
That is one ol the strengths of this system-wide initiative. Moreover, the databases at 
our disposal can be correlated with another regarding program design features such as 
length ol stay, degree of immersion, and percent of host -national staff. Thus luture 
analyses of these data — as well as of data arising from ocher populations, we hope — 
may bore deeper into the complexity of the study abroad experience so that particular 
patterns of learning outcomes can be linked to particular program configurations. 


Notes 

1 Duu collect ico procedure* were Approved by the University of Georgia Instituting Review- 
Beard and conform to all applicable ethical standards fee research studies of this type. Earlier 
versions cf this piper were presented it annual conferences of the AAHE Assessment Forum 
(Denver. June 2001), C1EE (Porting, November 2001), ISEP (Washington. November 2002) and 
NAFSA (San Antonio. May 2002). No portion <A this paper has been previously submitted for 
publication. As regards the sample, respondents for both groups who indicated they were nco- 
nanve speakers of English, were citizens cf a nation other than the U.S.. or had lived abroad for meet 
than one year (unless on military assignment) were eliminated from the sample, ^aestionnures 
containing significant amounts cf musing data were also discarded. 

To these were added a small number of study abroad participants from the summer of 2001 who 
had to be excluded from Phase II of the research project. 

1 Program directors' reporting of participants was necessary at this stage because we did not yet 
have cur more detailed data collection process fully in place. 

4 Copies of the complete instrument can be found on-line at httpii'/www.usg.edutoie&urveys or 
may be requested from the first author. 

’Seven composite variables corres pending co the seven factors were constructed by summing the 
unweighted constituent items for each factor. Resulting internal consistency coefficients (Cronbachs 
alpha) were .93 fof functional competencies, M2 for global interdependence. .73 for cultural 
relativism knowledge. .67 for verbal acumen. .72 for world geography, .66 for knowledge of 
interpersonal accommodation, and for cultural sensitivity, .30. Because the latter fell below the 
conventional standards for adequate reliability, results pertaining to this dimension must be 
interpreted with particular caution. 
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*We elected chit recce conservative standard because the dimensions are known to be correlated, 
and ic serves to protect a . 0 } family-wise mot rate of these seven multiple companion!. 

The covinate analysis of Factor 7 (cultural sensitivity) actually served to strengthen the impact of 
studying abroad. Whereas cultural sensitivity m the iiuoal set <A t -tests had been deemed unaltered 
by studying abroad, after extracting the variance due to the covan ace GPA, this test ww *i*J exceed 
the criterion tor statistical significance {f^^J.04; p<.002; eta 1 -.025X 7his final result means the 
impact of the international program cn cultural sensitivity would be that much greater ccaald chose 
who studied abroad be equated with those who did cot in terms of academic achievement. 
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